BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home]
[Evaluation Methods]
[Master Result Table]
[Team Profiles]
[System Profiles]
Final Evaluation Results
on REG-TOTAL events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[REG-TOTAL]== 1653 ( 582) 1282 ( 582) 35.21 45.40 39.66
[ConcordU ] ==[REG-TOTAL]== 1653 ( 447) 910 ( 447) 27.04 49.12 34.88
[JULIELab ] ==[REG-TOTAL]== 1653 ( 576) 1694 ( 576) 34.85 34.00 34.42
[UT+DBCLS ] ==[REG-TOTAL]== 1653 ( 429) 1038 ( 429) 25.95 41.33 31.88
[VIBGhent ] ==[REG-TOTAL]== 1653 ( 286) 908 ( 286) 17.30 31.50 22.34
[ UNSW ] ==[REG-TOTAL]== 1653 ( 274) 962 ( 272) 16.58 28.27 20.90
[ UTokyo ] ==[REG-TOTAL]== 1653 ( 233) 686 ( 233) 14.10 33.97 19.92
[ UZurich ] ==[REG-TOTAL]== 1653 ( 238) 811 ( 238) 14.40 29.35 19.32
[UAntwerp ] ==[REG-TOTAL]== 1653 ( 181) 613 ( 181) 10.95 29.53 15.98
[ Cam ] ==[REG-TOTAL]== 1653 ( 165) 437 ( 165) 9.98 37.76 15.79
[ SCAI ] ==[REG-TOTAL]== 1653 ( 209) 1263 ( 209) 12.64 16.55 14.33
[ Team 24 ] ==[REG-TOTAL]== 1653 ( 154) 801 ( 153) 9.32 19.10 12.52
[ NICTA ] ==[REG-TOTAL]== 1653 ( 129) 712 ( 129) 7.80 18.12 10.91
[ UAveiro ] ==[REG-TOTAL]== 1653 ( 104) 494 ( 104) 6.29 21.05 9.69
[CIPS-ASU ] ==[REG-TOTAL]== 1653 ( 196) 2404 ( 196) 11.86 8.15 9.66
[CNBMadrid] ==[REG-TOTAL]== 1653 ( 194) 2527 ( 194) 11.74 7.68 9.28
[ASU+HU+BU] ==[REG-TOTAL]== 1653 ( 86) 257 ( 86) 5.20 33.46 9.01
[ UMich ] ==[REG-TOTAL]== 1653 ( 233) 3582 ( 233) 14.10 6.50 8.90
[ USzeged ] ==[REG-TOTAL]== 1653 ( 69) 379 ( 69) 4.17 18.21 6.79
[ UNIMAN ] ==[REG-TOTAL]== 1653 ( 67) 400 ( 67) 4.05 16.75 6.53
[CCP-BTMG ] ==[REG-TOTAL]== 1653 ( 51) 106 ( 51) 3.09 48.11 5.80
[ Team 09 ] ==[REG-TOTAL]== 1653 ( 40) 336 ( 40) 2.42 11.90 4.02
[ PIKB ] ==[REG-TOTAL]== 1653 ( 18) 59 ( 18) 1.09 30.51 2.10
[ KoreaU ] ==[REG-TOTAL]== 1653 ( 11) 29 ( 11) 0.67 37.93 1.31
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[REG-TOTAL]== 1658 ( 418) 1038 ( 418) 25.21 40.27 31.01
[UAntwerp ] ==[REG-TOTAL]== 1658 ( 172) 613 ( 172) 10.37 28.06 15.15
[ Team 24 ] ==[REG-TOTAL]== 1658 ( 154) 818 ( 153) 9.29 18.70 12.41
[ASU+HU+BU] ==[REG-TOTAL]== 1658 ( 81) 257 ( 81) 4.89 31.52 8.46
[CNBMadrid] ==[REG-TOTAL]== 1658 ( 148) 2527 ( 148) 8.93 5.86 7.07
[CCP-BTMG ] ==[REG-TOTAL]== 1658 ( 50) 106 ( 50) 3.02 47.17 5.67
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------